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Docket No. 325772019900 



IMAGE PROCESSING DEVICE 



This application claims priority to Japanese 
Patent Application No. 11-319055 filed November 10, 1999, 
5 the entire content of which is hereby incorporated by 

reference. 



BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

10 The present invention relates to an image 

processing method including error diffusion processing, 
and an image processing device using this method. 



DESCRIPTION OF THE RELATED ART 

15 Conventionally, when performing color 

correction to improve color reproducibility of a color 
image between input and output devices , such color 
correction is accomplished by methods using a color look- 
up table describing the correspondence between the color 

20 of the input and output image at each color point within 

a color space, methods which determine a corresponding 
color using a color look-up table only for suitably 
quantified color points when there are many such color 
points and by interpolation from a certain color point in 
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a color look-up table for other color points, and 
conversion by calculation method based on masking theory. 

When the number of reproducible color in the 
output device is less than the number of colors of the 
5 input device, and when the amount of data are reduced for 

saving and transfer, a decrease of color depth is 
performed. In binary image output devices such as color 
displays and color printers which form each color point 
by mixing two primary colors, the input image is broken 

10 down to primary color components of yellow Y, magenta M, 

cyan C, or yellow Y, magenta M, cyan C, black Bk, or red 
R, green G, blue B, and the respective color components 
are subjected to stimulated gradient expression 
processing, then the obtained binary images are combined 

15 and output. 

This type of image processing uses an error 
diffusion process to diffuse errors generated when 
processing a target pixel to peripheral pixels. The 
colorimetric value of each output color is dependent on 

2 0 the device. When halftones are expressed using this same 

output device, the colors will appear different if the 
degree of dot overlay differs even though the dot 
generation rate of each color CMYBk is the same. However, 
in general color error diffusion processing, a device- 

25 dependent input signal is used and since the overlay of 
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dots of the same pixel is not considered, it is difficult 
to improve color reproducibility. 

A method for producing halftones in color 
vector space by error diffusion process is disclosed in 
5 Japanese Laid-Open Patent No. 9-307776. This method 

treats input image data as vectors, i.e., 
multidimensional quantities, not as unidimensional 
quantities. Although it is possible to use device- 
dependent color signals as color signals treated as 

10 vectors, in the following halftone process the input and 

output colors can be expected theoretically to match 
colorimetrically using an input image expressed with 
uniform color space such as XYZ, CIELAB and the like 
which are not device dependent, and using the XYZ value 

15 and CIELAB value of the colors outputtable by the output 

device known beforehand. The outputtable colors of binary 
image output devices are the eight colors of cyan, 
magenta, yellow, red, green, blue, white, and black, with 
white color often using the colorimetric value of the 

20 paper itself. 

( 1 ) The input color vector and the outputtable 
color vector are compared, and the color having the 
smallest vector of vector difference of the two colors is 
selected. That is, the outputtable color nearest the 

25 input color on the image space is selected. 
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( 2 ) The error between the input color and 
output color generated by the color selection is 
calculated . 

(3) The generated error in a processed pixel on 
5 the periphery of an unprocessed pixel is used for 

weighted addition to correct the input color. Thereafter, 

the process (1) is performed for the unprocessed pixels. 

This method is referred to as a vector error 

diffusion method, which makes possible high fidelity 
10 color reproduction using comparatively few colors, and 

readily corresponds to the outputtable color of halftones 

and spot color addition. 

Conventional image processing devices using a 

vector error diffusion method have certain disadvantages 
15 arising from the paucity selectable output colors, 

including texture noise wherein a certain specific 

selection color appears periodically, and markedly 

reduces the printed image (particularly graininess) of 

the image. 

20 

SUMMARY OF THE INVENTION 

An object of the present invention is to 
provide an image processing device which reduces periodic 
noise of color components, and provides high quality 
25 output images. 



In the present invention, a method of 
intentionally superimposing a noise on image data is 
applied to the error diffusion method, which is known as 
a method of reducing graininess . 
5 These and other objects are attained by an 

image processing device, comprising an error adding unit 
for correcting the color of each pixel of an input image 
in accordance with the error data; an output color 
selector for converting the color corrected by the error 

10 adding unit to a single color selected from among a 

plurality of outputtable colors; an error calculator for 
generating data for diffusing the color error converted 
by the output color selector to pixels peripheral to a 
target pixel, and contributing these data to the error 

15 adding unit; and a noise overlay unit for superimposing 

noise on the input image and provided as a front stage to 
the error adding unit. 

The invention itself, together with further 
objects and attendant advantages, will be best understood 

20 by reference to the following detailed description taken 

in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a block diagram showing an example of 
25 the structure of the image processing device; 
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FIG. 2a through FIG. 2c show an example of 
intentionally superimposed noise; and 

FIG. 3a through FIG. 3c show another example of 
intentionally superimposed noise. 
5 In the following description, like parts are 

designated by like reference numbers throughout the 
several drawings. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

10 FIG. 1 is a block diagram showing an example of 

the structure of the image processing device. 

The image processing device 1 of FIG. 1 is used 
integrated with a computer system and color printer, and 
performs a decreasing process on color depth of input 

15 image data to be printed, displayed, or saved. In the 

image processing device 1, a periphery error adding unit 
11, output color selector 12, and error calculator 13 are 
basic structural elements for color conversion using a 
vector error diffusion method. A noise overlay unit 14 is 

2 0 an added structural element characteristic of the present 

invention . 

Image data are treated as CIELAB color space 
data from the time they are input to the image processing 
device 1 until output therefrom. Other multidimensional 



data in the color space such as XYZ color space, CIELCH 
color space and the like also may be used. 

The input image Gl is processed pixel by pixel 
sequentially in the raster scan direction. The periphery 
5 error adding unit 11 corrects data of a target pixel of 

the input image Gl in accordance with the error data D13 
from the error calculator 13. Error data D13 are weighted 
color conversion error of a previously processed pixel, 
and represent the data allocated to the target pixel 

10 among the distribution error allocated to the peripheral 

pixels. A weighted matrix (diffusion matrix) not shown in 
the drawing is used in error allocation, so as to 
allocate the error from a plurality of pixels within the 
matrix to the target pixel. Accordingly, the error data 

15 D13 is the total of distribution errors of a plurality of 

pixels. The error calculator 13 sequentially adds and 
stores the distribution error of each pixel. The output 
color selector 12 selects, pursuant with specific rules, 
one outputtable color for a target pixel the data of 

20 which has been corrected by the error adding unit 11. The 

output image G12 is reproduced using the selected output 
color. For example, an output device for image 
reproduction is a digital color printer which has eight 
outputtable colors (cyan (C), magenta (M) , yellow (Y), 

25 red (R), green (G), blue (B), white (W) , and black (Bk)). 
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The previously mentioned specific rules are rules for 
selecting the color nearest the input color in the color 
space. More specifically, the rule simply compares the 
target color vector V and each output color vector Vi, 
5 and selects the color having the smallest difference 

vector | V-Vi| . In this rule, since the color of the 
pixels adjacent to the target pixel influence the region 
of the target pixel, the color actually perceived in the 
target pixel may differ from the output color vector Vi. 

10 When the perceived color is designated Vi' , a rule 

selecting the color having the smallest difference vector 
|v-Vi'| is most appropriate. 

A noise overlay unit 14 is provided in the 
image processing device 1 as a front stage of the 

15 peripheral error adding unit 11. The noise overlay unit 

14 superimposes a noise component described later on the 
input image Gl to suppress the generation of biased 
texture of the color component. The graininess of the 
output image is improved without loss of color tone by 

20 selecting suitable noise. 

FIG. 2 shows an example of intentionally 
overlaid noise. In this example, the objects of noise 
overlay are the image data in the L*a*b* color space, and 
the outputtable colors are C, M, Y. 



If the colorimetric value (L* value, a* value, 
b* value) of the respective outputtable colors C, M, Y 
are previously known, texture generation of the color 
component in a uniform patch image can be suppressed by 
5 superimposing Gaussian distribution noise having this 

value at its center. Furthermore, the color tone of the 
entire image is maintained if the total sum of the 
relative amount of overlay noise is zero relative to the 
colorimetric value of each outputtable color. 

10 FIG. 3 shows another example of intentional 

overlay noise. In this example, the objects of noise 
overlay are the image data in the L*C*h color space, and 
the outputtable colors are C, M, Y. 

In the case of the L*C*h color space also, the 

15 color tone of the entire image is maintained if the total 

sum of the relative amount of overlay noise is zero 
relative to the colorimetric value of each outputtable 
color. 

Since the noise is overlaid in the L*a*b* color 
20 space or the L*C*h color space in the present embodiment, 

quantitative image quality evaluation matching human 
perception is possible, and the overlay noise can be 
effectively optimized. 

in the above embodiment, the noise conditions 
25 (noise amount, distribution) may be modified in 
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accordance with the resolution of the output device such 
as a printer, and the image attributes (text and 
photographic areas). The noise also may be modified for 
each pixel. The output color selection rule need not be a 
5 single, fixed rule, but rather a plurality of rules may 

be properly used in accordance with the content of the 
input image and the purpose of the output image and the 
like. According to the present embodiment described above, 
the color of an input image can be reproduced with high 

10 fidelity using a few colors, and periodic noise of color 

components is reduced so as to improve the quality of the 
output image. 

Although the present invention has been fully 
described by way of examples with reference to the 

15 accompanying drawings, it is to be noted that various 

changes and modification will be apparent to those 
skilled in the art. Therefore, unless otherwise such 
changes and modifications depart from the scope of the 
present invention, they should be construed as being 

20 included therein. 
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WHAT IS CLAIMED IS: 

1. An image processing apparatus, comprising: 
an error adding unit for correcting the color 

of each pixel of an input image in accordance with an 
error data; 

an output color selector for converting the 
color corrected by the error adding unit to a single 
color selected from among a plurality of outputtable 
colors of the image processing apparatus; 

an error calculator for generating the error 
data for diffusing the color error converted by the 
output color selector to pixels peripheral to a target 
pixel, and contributing the error data to the error 
adding unit; and 

a noise overlay unit for superimposing noise on 
the input image and provided as a front stage to the 
error adding unit. 

2. An image processing apparatus according to 
claim 1, wherein color of each pixel of an input image is 
corrected by vector error diffusion method. 

3. An image processing apparatus according to 
claim 1, wherein the noise is color data having relation 
to the colorimetric value of each outputtable color. 

4. An image processing apparatus according to 
claim 1, wherein the noise is selected so that the total 
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sum of the relative amount of overlay noise is zero 
relative to the colorimetric value of each outputtable 
color. 

5. An image processing method, comprising steps 

5 of: 

superimposing noise on an input image; 

correcting the color of each pixel of the noise 
overlaid input image in accordance with an error data; 

converting the corrected color to a single 
10 color selected from among a plurality of outputtable 

colors ; 

generating the error data for diffusing the 
error generated when selecting the outputtable color of 
the target to pixels peripheral to the target pixel; and 
15 contributing the error data to said step of 

correcting . 

6. An image processing apparatus, comprising: 
correcting means for correcting the color of 

each pixel of an input image in accordance with an error 
20 data; 

converting means for converting the color 
corrected by said correcting means to an outputtable 
color; 
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generating means for generating the error data 
for diffusing the color error converted by said 
converting means to pixels peripheral to a target pixel; 

contributing means for contributing the error 
5 data to said correcting means; and 

superimposing means for superimposing noise on 
the input image and provided as a front stage to said 
correcting means. 

7. An image processing apparatus, comprising: 
10 superimposing means for superimposing noise on 

an input image; and 

correcting means for correcting color of each 
pixel of the image on which noise is superimposed by 
vector error diffusion method. 
15 8. An image processing apparatus according to 

claim 7, wherein the noise is color data having relation 
to the colorimetric value of each outputtable color of 
the image processing apparatus. 

9. An image processing apparatus according to 
20 claim 7, wherein the noise is selected so that the total 

sum of the relative amount of overlay noise is zero 
relative to the colorimetric value of each outputtable 
color. 
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ABSTRACT OF THE DISCLOSURE 

Disadvantages of conventional image processing 
devices using a vector error diffusion method include the 
generation of periodic texture noise of specific selected 
5 colors, resulting in marked reduction of graininess. A 

noise overlay unit is provided as a front stage of an 
error adding unit for adding error to input image data. 
If noise is superimposed on the L*a*b* color space or 
L*C*h color space, quantitative image evaluation matching 
10 human perception is possible, and overlay noise can be 

effectively optimized. If the total sum of the absolute 
amount of overlay noise is zero, the color tone of the 
entire image can be maintained. 



14 



NOISE 
OVERLAY 
UNIT 



PERIPHERY 
ERROR 
ADDING 
UNIT 



D/5 



12- 



OUTPUT 
COLOR 
SELECTOR 



ERROR 
CALCULATOR 



'/a 



FIG. 1 




FIG. 2c 




FIG. 3c 



PATENT 
Docket No. 



Client Ref. 



COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR UTILITY/DESIGN PATENT APPLICATION 



AS A BELOW-NAMED INVENTOR, I HEREBY DECLARE THAT: 

My residence, citizenship, and post office address are as stated below next to my name. 

I believe I am the original, first and sole (or joint, if more than one name appears below) 
inventor of the subject matter which is claimed and for which a patent is sought on the invention 
entitled: 

IMAGE PROCESSING DEVICE 
the specification of which: 
El is attached hereto. 

□ was filed on as application serial No. and was amended 

on (if applicable). 

I HAVE REVIEWED AND UNDERSTAND THE CONTENTS OF THE ABOVE- 
IDENTIFIED SPECIFICATION, INCLUDING THE CLAIMS, AS AMENDED BY ANY 
AMENDMENT REFERRED TO ABOVE. 



I acknowledge and understand that I have a duty to disclose information which is material 
to the patentability of the claims of this application in accordance with Title 37, Code of Federal 
Regulations, §§ 1.56(a) and (b). 

I hereby claim foreign priority benefits under Title 35, United States Code § 1 19(a)-(d) of 
the foreign application(s) for patent indicated below and have also identified below the foreign 
applications for patent or inventor's certificate on this invention having a filing date before that of 
the application for patent or inventor's certificate on this invention having a filing date before that 
of the application on which priority is claimed: 



Country/International 


Application No. 


Date of Piling 
(day/month/year) 


Priority Claimed? 


Japan 


11-319075 


10/11/1999 


mYes 


□No. 








□Yes 


□No. 








□Yes 


□No. 








□Yes 


□No. 








□Yes 


□No. 



I hereby claim benefit under Title 35, United States Code, § 1 19(e) of any United States 
provisional application(s) listed below: 



Application Serial No. 


Filing Date . 











I hereby claim benefit under Title 35, United States Code, § 120 of any United States 
application(s) listed below, and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States application in the manner provided by the 
first paragraph of Title 35, United States Code § 1 12, 1 acknowledge the duty to disclose material 
information as defined in Title 37, Code of Federal Regulations, §§ 1.56(a) and (b) set forth 
above which occurred between the filing date of the prior application and the national or PCT 
international filing date of this application: 



Application Serial No. 


Filing Date 


Status 






□Patented DPending DAbandoned 






□Patented DPending ^Abandoned 






□Patented DPending DAbandoned 



I hereby appoint the following attorneys and agents to prosecute that application and to 
transact all business in the Patent and Trademark Office connected therewith and to file, to 
prosecute and to transact all business in connection with all patent applications directed to the 
invention: 

Thomas E. Ciotti (Reg. No. 21,013) 
Gladys H. Monroy (Reg. No. 32,430) 
Barry E. Bretschneider (Reg. No.. 28,055) 
Freddie K. Park (Reg. No. 35,636) 
Paul C. Kimball (Reg. No. 34,641) 
Shmuel Livnat (Reg. No. 33,949) 
Tyler Dylan (Reg. No. 37,612) 
Thomas G. Wiseman (Reg. No. 35,046) 
Antoinette F. Konski (Reg. No. 34,202) 
E. Victor Donahue (Reg. No. 35,492) 
Laurie Axford (Reg. No. 35,053) 
Catherine M. Polizzi (Reg. No. 40,130) 
Thomas D. Mays (Reg. No. 34,524) 
Richard D. Jordan (Reg. No. 33,519) 



Please direct all communications to: 

Barry E. Bretschneider 
Morrison & Foerster LLP 
2000 Pennsylvania Avenue, N.W. 
Washington, D.C. 20006-1888 

Please direct all telephone calls to Barry E. Bretschneider at (202) 887-1500. 

I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that these 



Kate H. Murashige (Reg. No. 29,959) 
Debra Shetka (Reg. No. 33,309) 
Thomas E. Wheelock (Reg. No. 28,825) 
Stephen C. Durant (Reg. No. 31,506) 
Patricia M. Drost (Reg. No. 29,790) 
Cecily Anne Snyder (Reg. No. 37,448) 
Edward G. Durney (Reg. No. 37,61 1) 
Madeline I. Johnston (Reg. No. 36,174) 
Harry J. Macey (Reg. No. 32,818) 
Robert Saltzberg (Reg. No. 36,910) 
Mani Adeli (Reg. No. 39,585) 
Sean Brennan (Reg. No. 39,917) 
J. Michael Schiff (Reg. No. 40,253) 



2 



Docket No. 



statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under § 1001 of Title 18 of the United States Code 
and that such willful false statements may jeopardize the validity of the application or any patent 
issued thereon. 



(. wT^Z & TfaTiirmii S AT£ ATA"NT 



Name: " Kazuomi SAKATANI 

Residence: Toyokawa-Shi, Aichi-Ken, Japan 

Citizenship: Japan 

Post Office Address: c/o Minolta Co., Ltd , Osaka Kokusai Bldg. 3-13, 2-Chome, Azuchi-Machi, Chuo-Ku, 
Osaka-Shi, Osaka, 541-8556, JAPAN 



3 



Docket No. 



